Evidence of non-mean-field-like low-temperature behavior in the Edwards-Anderson spin-glass 

model 
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The three-dimensional Edwards-Anderson and mean-field Sherrington-Kirkpatrick Ising spin glasses are 
studied via large-scale Monte Carlo simulations at low temperatures, deep within the spin-glass phase. Perform- 
ing a careful statistical analysis of several thousand independent disorder realizations and using an observable 
that detects peaks in the overlap distribution, we show that the Sherrington-Kirkpatrick and Edwards-Anderson 
models have a distinctly different low-temperature behavior. The structure of the spin-glass overlap distribution 
for the Edwards- Anderson model suggests that its low-temperature phase has only a single pair of pure states. 
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Spin glasses (H have been the subject of intense study and 
controversy for decades. These models are perhaps the sim- 
plest, physically-motivated examples of frustrated systems in 
classical statistical mechanics. Given their wide applicability 
across disciplines, it is important that their behavior is under- 
stood. Despite four decades of research, the low-temperature 
phase of short-range spin glasses is poorly understood. Here 
we study both the three-dimensional (3D) Edwards-Anderson 
(EA) Ising spin glass J3] and the Ising spin glass on a complete 
graph — known as the Sherrington-Kirkpatrick (SK) model 
130 — in an effort to gain a deeper understanding of the low- 
temperature spin-glass state. Our results suggest that these 
models are qualitatively different at low temperatures. 

Parisi's solution of the SK model 0,(3] involves an unusual 
form of symmetry breaking among replicas. These were orig- 
inally introduced to carry out the disorder average of the loga- 
rithm of the partition function. The low-temperature phase of 
the model within the replica symmetry breaking (RSB) solu- 
tion has several unusual features such as the breakdown 
of self-averaging and the co-existence of a countable infinity 
of pure states in the thermodynamic limit. 
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FIG. 1: (Color online) (a) In the droplet picture P(q) is trivial with 
one pair of pure states, (b) In the RSB picture individual samples 
have many pairs of pure states (S functions in Pj(q)). (c) In the 
RSB picture P(q) is nontrivial (continuous support for \q\ < (?ea). 

There is no analytic theory for the EA model but it is well- 
accepted on the basis of numerical simulations ||6t] that the 
EA model undergoes a continuous phase transition. However, 
the low-temperature broken-symmetry phase is not under- 
stood, even qualitatively. Different mutually-exclusive sce- 
narios have been proposed: The replica symmetry breaking 
(RSB) picture is based on an analogy with the solution of the 



SK model. It assumes that self-averaging breaks down and 
that there are a countable infinity of pure states in the thermo- 
dynamic limit. A qualitatively different and simpler picture 
was proposed to describe the EA model by McMillan, Fisher 
and Huse, as well as Bray and Moore J7 - IT ] . In the "droplet 
scaling" picture the low-temperature phase is described by one 
pair of pure states related by a spin flip with low-lying excita- 
tions that are isolated, compact droplets of the opposite phase. 
A central difference between the RSB and droplet pictures for 
the EA model is whether there is a single pair of pure states or 
many pairs of pure states for large systems, see Fig. Q] 

Newman and Stein Il2l4l411 explained that the usual way 
of constructing the thermodynamic limit cannot be applied to 
finite-dimensional spin glasses because of the possibility of 
a chaotic system-size dependence in which different thermo- 
dynamic states may appear for different system sizes. They 
showed that the key ideas of RSB — non-self-averaging and 
a countable infinity of pure states — cannot hold for the EA 
model within the naive way that they were first proposed. 
However, their results do not completely rule out a nonstan- 
dard interpretation of RSB. They also proposed a more plau- 
sible many-states "chaotic pairs" picture in which for a fixed 
choice of couplings, there are many pure states but that in a 
single finite volume only one pair is manifest. 

Here we report the results of large-scale Monte Carlo simu- 
lations of both the SK and EA models. Our objective is to shed 
light on the qualitative nature of the low-temperature phase of 
the EA model by comparing and contrasting to the SK model. 
Previous numerical studies, e.g., IU5I1 using the average spin 
overlap distribution suggested that both the SK and EA mod- 
els are well described by the RSB picture. However, for the 
numerically-accessible system sizes the two main peaks are 
still converging to ±<?ea ( see Fig- E} and therefore results 
might be plagued by finite-size effects. On the other hand, 
studies of the link overlap 111311 distribution suggest agreement 
with the droplet picture. The "trivial nontrivial" scenario lfl5l - 



1711 reconciles these numerical results by postulating that exci- 



tations are compact, as in the droplet picture, but their energy 
cost is independent of system size, as in the RSB picture. In 
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an effort to resolve these discrepancies, here we introduce a 
statistic obtained from the spin overlap distribution that de- 
tects sharp peaks in individual samples, inspired by a recent 
study on the SK model fiUl . This statistic clearly differenti- 
ates the RSB and droplet pictures: it converges to zero in the 
large-volume limit if there is a single pair of pure states and to 
unity if there are countably many. Our results for this quantity 
shows clear differences between the EA and SK models. 

Models and Numerical Details. — The SK and EA models 
are defined by the Hamiltonian H = — Ylij=i JijSiSj, with 
Si 6 {±1} Ising spins. For the EA model the sum is over 
nearest neighbors on a cubic lattice of size N = L 3 with peri- 
odic boundaries. The couplings are chosen from a Gaus- 
sian distribution with zero mean and variance unity. A set of 
couplings J = {Jij } defines a disorder realization or, simply, 
a "sample." For the SK model the sum is over all pairs of spins 
and the Jy are chosen from a Gaussian distribution with zero 
mean and variance 1 / (N — 1). 

Ordering in spin glasses is detected from the spin overlap 
q = (1/AT) SfS?, where "a" and indicate indepen- 
dent spin configurations for the same sample J . The primary 
observable we consider for fixed J and N is the overlap prob- 
ability density, Pj(q). In the high-temperature phase there is 
a well-defined thermodynamic limit and Pj(q) — > 6(q) for 
N — > oo for almost every J . The behavior of Pj (q) for large 
N and T < T c , T c the critical temperature, distinguishes the 
RSB picture from other theories. If there is only a single pair 
of states for each system size, Pj (q) consists for large N of a 
symmetric pair of 6 functions at the Edwards-Anderson order 
parameter q = ±<?ea, see Fig. |l(a)| In the RSB picture there 
are many sharp peaks symmetrically distributed in the range 
—Qea < q < qEA as shown in Fig. |l(b)| corresponding to 
multiple pairs of pure states. In the RSB picture, the distribu- 
tion of peaks depends on J but the disorder averaged overlap 
distribution P(q) exists, and for large N is expected take the 
form shown in Fig. |l(c)| 
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We have carried out replica exchange Monte Carlo 1119 1 
simulations of both models. Parameters are shown in Tables 
|T]and[TT] For each sample we equilibrate two independent sets 
of replicas to compute the overlap distribution. Equilibra- 
tion is tested for the EA and SK models using the methods 
of Refs.|15] and I20I1 . respectively. The number of equilibra- 
tion and data collection sweeps are chosen to be long enough 
to ensure that samples are well equilibrated and that Pj(q) is 
accurately measured for each sample. We report results for 
T = 0.42 [T = 0.4231] for the EA [SK] model. For the EA 
model, T c w 0.96 0], while for the SK model T c = 1, so 
our simulations are at ~ 0.4T C , i.e., deep within the spin-glass 



phase [21] where critical fluctuations are unimportant. 

Results. — Figure [2] shows Pj (q) for three different EA 
samples (N = 512 = 8 3 , T = 0.42). Note that Pj{q) 
varies considerably between samples. Qualitatively similar 
overlap distributions are seen for the SK model. Figure [3] 
left panel [right panel], shows the disorder averaged overlap 
distribution P(q) for the EA [SK] model for different system 
sizes at T = 0.42 [T = 0.4231] JH. At this low temper- 



L we equilibrate and measure for 2 Monte Carlo 
sweeps. T m i n [T max ] is the lowest [highest] temperature and Nt is 
the number of temperatures. A/ sa is the number of disorder samples. 
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TABLE II: Simulation parameters for the SK spin glass. 


See the 


TableUfor details. 
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ature, P(q) consists of large peaks at the finite-size value of 
the EA order parameter, ±<7ea(A0- P(q) is reasonably flat, 
non-zero, and nearly independent of N in the approximate 
range —0.4 < q < 0.4 for the sizes studied here. We can 
quantify this observation by considering the integrated over- 
lap, I(qa) = f\ q \ <qo P(o)dq. Figure|4]shows /(0.2) as a func- 
tion of N for both the EA and SK models at T « 0.4T C JH |. 
Note that /(0.2) is nearly independent of N. We found qual- 
itatively similar results for other values of q U P to q w 0.5 
and temperatures down to 0.2T C for smaller systems. The con- 
stancy of 7(0.2) has been observed in a number of studies (see 
Refs. Ql and |Q) and is among the strongest evidence in fa- 
vor of the validity of the RSB picture for short-range systems. 

Although I(<7o) m Fig.|4]is nearly constant over the range of 
sizes simulated in this and other studies of the EA model, it is 
also clear that, for these same sizes there are strong finite- size 
effects. These corrections can be seen by looking at the size 
dependence of <tea(-W)- The peak moves to smaller values of 
<?ea as Af increases, similar to recent results I123ll for larger N. 
The presence of these strong finite-size corrections makes the 
absence of any significant N dependence of P(q) for small q 
surprising. In the droplet picture, /(go) is expected to decay 
with a small power of L, I(q ) - TL~ 9 (9 w 0.2 in 3D Q) 
and this slow asymptotic behavior may not set in until large 
sizes. Thus the behavior of I(qo) shown in Fig. [4] may n °t 




FIG. 2: (Color online) Typical overlap distributions Pj(q) for three 
disorder realizations for the EA model with N = 8' ! and T = 0.42. 



3 





-0.5 



0.5 



FIG. 3: (Color online) Disorder- averaged overlap probability distri- 
bution P(q) for different system sizes at T = 0.42 and T = 0.4231 
for the EA model (left) and SK model (right), respectively. 
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FIG. 4: (Color online) Disorder average of the weight of the overlap 
distribution 1(0.2) as a function of N for T « 0.4T C for both the 
EA and SK models. 



be a sensitive indicator of the nature of the low-temperature 
phase for system sizes currently accessible to simulation. 

To better understand the size dependence of the overlap dis- 
tributions, we go beyond disorder averages and consider other 
statistics obtained from Pj{q). In particular, we identify the 
emergence, or not, of 5 functions in the range — qea < q < 
<7ea as N increases, which would signal more than one pair 
of pure states. A finite-size broadened S function at q is char- 
acterized by a large value of Pj{q). To detect <5-function-like 
behavior for finite N we consider the statistic 



A (g , «) =Prob 



max 

l<?l<<?0 



-{Pj{q) + Pj(-q)) 



> re 



(1) 

The probability is defined with respect to J and A (go, re) is 
the fraction of samples with at least one peak greater than k in 
Pj(q) in the range |g| < go. re is chosen to be large enough to 
exclude some but not all samples. We refer to samples counted 
in A(go, re) as "peaked.'" For example, with k = 1 the sample 
with the central peaks (black line) in Fig.|2]is peaked for go > 
0.1, whereas the two other samples are not for go < 0.5. 
The droplet and RSB pictures make dramatically different 
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FIG. 5: (Color online) Fraction of peaked samples A (go, re) at T , 
0AT c as a function of N for k = 1, go = 0.2 and 0.4. 




2.6 2.8 3.0 3.2 2.2 2.4 2.6 2.8 3.0 3.2 

lo g 10 ^ iog 1( A 

FIG. 6: (Color online) Contours of constant A for the EA model 
(left) and the SK model (right) as a function of log 10 (A) and 
log 10 (/t/Ko) with «o = 0.5 and 1.5 for go = 0.2 and 1.0, re- 
spectively. The solid [dashed] lines are contours of constant A for 
go = 0.2 [go = 1.0] equally spaced in A l27ll . 



predictions for A(g , re). For the droplet or chaotic pairs pic- 
ture there is only a single pair of states for any large volume 
so that A (go, re) — > for any k > and any go < gEA 
when A" — > oc. However, for the RSB picture one expects 
5 functions in Pj(q) for any range of g, i.e., A(go, re) — >• 1 as 
A" — > oo for any go and re > 0. 

Figure [5] shows A(go,re) as a function of system size for 
go = 0.2 and 0.4, as well as k = 1 12511 . We found qual- 
itatively similar results for other values of go and re, as well 
as for lower temperatures. Our most important observation is 
that the fraction of peaked samples A(go, re) is nearly constant 
and small for the EA model while A(gg, k) is increasing over 
the same range of N for the SK model 126]]. The result for the 
SK model is expected from Parisi's RSB solution. The con- 
trasting result for the EA model suggests that the number of 
pure states does not grow with the system size for low T; a 
result consistent with the droplet and chaotic pairs pictures. 

The difference in the behavior of A for the SK model in 
comparison to the EA model might be explained by the fact 
that peaks sharpen more quickly with N for the SK than for 
the EA model (see Fig. [3] and Ref. lEih . To study this effect, 
we compare A for the two values, go = 0.2 and go = 1, for 
each model separately. For go = 1, A is controlled by the 
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peaks at ±qea and must converge to unity for both models 
because for N — > oo the q-EA peaks become 5 functions. Fig- 
ure [6] left [right] panel, shows contour plots of constant A for 
the EA [SK] model. The horizontal axis is the logarithm of the 
number of spins and the vertical axis is the logarithm of k/ko 
with kq = 0.5 for go = 0.2 and = 1.5 for qo = 1. The 
curves are lines of constant A obtained from a linear interpo- 
lation of the data. Each set of curves are equally spaced in A 
1 2711 with A decreasing as k increases. The dashed contours 
are for qo = 1 and thus include the q^A peaks. As expected, 
the dashed contours are clearly increasing functions for both 
models although they rise more rapidly for the SK model than 
for the EA model. The solid curves are contours of constant 
A for go = 0-2- Close inspection of the data reveals a quali- 
tative difference between both models. For large N and large 
A, the SK go = 0.2 contours rise more steeply than the corre- 
sponding go = 1 contours, suggesting that not only are peaks 
sharpening, but the number of peaks is also increasing. In 
fact, Ref. 11811 shows that the number of peaks in Pj (q) should 
scale as N 1 ^ 6 for the SK model. On the other hand, for large 
N and large A, the EA contours for go = 0.2 are nearly flat, 
rising less steeply than for go = 1, suggesting that the number 
of peaks is either decreasing or staying constant. 

Conclusions. — We introduce a statistic A that detects the 
fraction of samples with S function behavior in Pj (q) near the 
origin and sharply distinguishes the RSB picture from scenar- 
ios with only a single pair of states such as the droplet picture. 
While our results for the SK model are consistent with RSB, 
as expected, the EA model does not display a trend towards 
many pairs of pure states. These results lend weight to the 
droplet and chaotic pairs pictures It is also possible that for 
the EA model, A increases very slowly in N and ultimately 
converges to unity in agreement with the RSB picture. How- 
ever, our data show no indication of such trend. It would be 
interesting to perform a similar analysis with extremely large 
data sets computed with special-purpose computers, such as 
the Janus machine l29ll . 
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